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Abstract 

Recently Abe (arXiv:cond-mat/1005.5110vl) claimed that the g-entropy of 
nonextensive statistical mechanics cannot be generalized for the continuous vari- 
ables and therefore can be used only in the discrete case. In this letter, we show 
that the discrete q-entropy can be generalized to continuous variables exactly in the 
same manner as Boltzmann-Gibbs entropy, contrary to the claim by Abe, so that 
q-entropy can be used with discrete as well as continuous variables. 

PACS: 05.20.-y, 05.70.-a 



'Corresponding author: baris.bagci@ege.edu.tr 



1 



1 Introduction 



As Abe very recently reminded [1], Boltzmann-Gibbs (BG) entropy has originated 
mainly for the case when the random variable takes finite number of values [2|. When 
this is the case, BG entropy, setting Boltzmann constant to unity, is given by 

n 

S{pi) ^ -^Pi\np^. (1) 

i=l 

In order to generalize the discrete expression above to the continuous case, the usual 
practice is to assume the existence of a probability density function p{x), which is 
equal to or greater than zero in some interval [a, b]. In addition to this, the criterion 
of normalization is assumed to be satisfied by p{x) in the interval [a, b]. Then, in a 
straightforward manner, Eq. ([TJ is extended to the continuous variables as 

b 

S{p) — ~ J p{x)\np{x)dx. (2) 

a 

Although this generalization by itself seems reasonable, three serious drawbacks 
can be noted at once. First, probability densities usually have a unit of inverse of length 
in one dimensional continuum. Then, S{p) possesses an overall unit of log(length) in 
contrast to the dimensionless discrete entropy expression S{pi) in Eq. ([T]i. Second, 
S{p) is not invariant with respect to coordinate transformations deeming it vulnerable 
to Bertrand paradox The last but not the least, the discrete BG entropy S{pi) in 
the n ^ oo limit and S{p) yield different results. In order to show this, we consider a 
uniform distribution in the interval [a, b] i.e., 

P{x) = (3) 

such that the corresponding probabilities in the discrete case, assuming that the interval 
[a, b] is divided in n equal subintervals, are of the form 

p{xi) = - (4) 
n 

where i = 1, 2, n. The calculation of the continuous entropy S{p) with the proba- 
bility density given by Eq. (O results in 

S{p) = ln(6 - a) (5) 
whereas the discrete form S{pi) together with Eq. (HJl yield 

Sip,)^Hn). (6) 

The discrete entropy S{pi) attains the infinity in the n ^ oo limit, whereas the contin- 
uous version S{p) is independent of n, and again equal to \n{b — a). Summing up, the 
so-called continuous version S{p) of the discrete BG entropy S{pi) is not tenable and 
cannot be used in the continuum. 
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Although the solution to this dilemma is known in the case of BG entropy in detail 
||2l as reviewed in the next section too for the sake of completeness of our treatment, 
Abe ||T] recently argued that the same cannot be said for the g-entropy proposed by 
Tsallis 13] 11] and deduced that the g-entropy is properly functional only in the dis- 
crete case. In this paper, we show that the g-entropy can indeed be generalized to the 
continuous case as naturally as BG entropy so that Abe's desideratum is satisfied and 
therefore the conclusion reached by Abe is shown to be unfounded. 



2 Extension to the Continuum: Boltzmann-Gibbs en- 
tropy 

In this section we review the generalization of BG entropy in the case of random vari- 
ables, since g-entropy is generalized almost in the same manner as BG entropy. Despite 
the fact that one can have different derivations of this generalization depending on the 
level of rigor, we follow Abe's treatment ([T], which is identical to the one by Jaynes 
(see p. 375 in Ref. |5| for example). In order to extend BG entropy to the contin- 
uum, we consider an interval [a, b] so that the discrete points Xi with i = 1, 2, n fill 
the interval. Then, the relation between the discrete probability pi and the probability 
density p{xi) is given by |[l]|5] 

pjXj) 

— r^- (7) 
As the number of points increases and tends to infinity, one can write lH] |5] 



lim — - = / 



b 

dx. (8) 



. , ....^(Xi) 
*=1 a 

Substitution of Eq. (|7|l into the discrete entropy expression given by Eq. ([T]l yields 



^—^nm^Xi) \nm(Xi)J 



Eq. ([9]) can now be rewritten as 



^ — 'nm(Xi) XmiXiiJ ^ — 'nm(Xi) 
SO that Eq. dTol l. using Eq. ^ in the n — > cxd limit, becomes 

6 b 

S^- J dxp (x) In (^£;^) + In {n) J dxp (x) . (11) 

a a 

It is crucial to understand that the left hand side of the equation above is discrete BG 
entropy given by Eq. but when one considers it in the n — > oo limit i.e., continuous 
limit. Eq. (fTTT l. due to normalization, can be rewritten as 
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b 

.^-/d.,(.)ln(£|)) (12) 

a 

where the additive divergent term lini„_>oo In {n) is omitted since the entropy is not 
absolute but only its change can be measured. Then, this equation indicates that the 
continuous form of BG entropy (remember that the left hand side of the equation above 
is discrete BG entropy but in the n — > oo limit) is given by the negative of the relative 
entropy i.e., right hand side of Eq. (fT2b as discussed in |[T]|5l. The integral in the right 
hand side i.e., the extension of BG entropy to continuum is called relative entropy or 
Kullback-Leibler entropy, since it was first proposed by Kullback and Leibler |6 |. It 
is worth remarking that the relative entropy expression given by Eq. (fTZt is dimen- 
sionless like its discrete counterpart, and invariant under different reparametrization of 
continuum. 



3 Extension to the Continuum: g-entropy 

BG entropy is the cornerstone of statistical mechanics and its maximization yields ex- 
ponential distributions. On the other hand, there are many physical systems exhibiting 
inverse power law distributions (see Ref. [4| for a survey). Therefore, the discrete q- 
entropy was proposed 13J |4) as a generalization of BG entropy measure in order to 
investigate certain classes of such systems. The nonadditive q-entropy reads 



" / 1 \ " 



4=1 

where g-logarithm is defined as 



(13) 



In, (a;) = (14) 

for X > Q. Note that (/-logarithm becomes the ordinary logarithmic function in the 
g — > 1 limit so that the discrete (/-entropy in Eq. (fT3T l takes the form of ordinary BG 
entropy. 

In order to extend the discrete (/-entropy definition in Eq. ( fT3] ) to continuum, we 
consider an interval [a, b] filled by the discrete points Xi where the index i runs up to n, 
exactly as in the previous section. Then, the relation between the discrete probability 
Pi and the probability density p{xi) ||T1|5] is given by Eq. ^ with m — ^ to,, where 
mq{xi) is the g-generalized m{xi) measure, relevant for a nonextensive system, as 
mentioned also in Ref. HI, and present the essential difference between ordinary and 
g-statistics. Therefore, one can write 

^,--E^^ln2_,f^i^). (15) 
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Let us now define the •mq{xi) measure as follows 

n -1 



P{Xt) 



02-g n 



(16) 



where 02-g is the generalized division originally introduced in ||71 [8] as x 0g y = 

— y^~'^ + l] ^^'■^ ''\ for q ^ 2 — q and mq^i{xi) — m{xi). The measure 
mq{xi) is consistently defined since it has again the dimension of a probability and let 
Aajj tend to zero for n — ^ oo. Then, by virtue of Eq. ( fTSI l, we obtain from Eq. ( fTsT l 

-A p{x^) ( p{x^)\ -A p{x,) 

Using Eq. (O in the n — > oo limit with m — > rriq, we can write Eq. ( fTTI l in the 
continuous case as 

Sq = - j dxp{x)\n.2-q {~^^^ + \TL2-q{n) J dxp{x) . (18) 
a a 

It is clearly seen that the left hand side of this equation is discrete g-entropy given by 
Eq. (fT3T l when it is considered in the n — > cxd limit. Eq. ( fTsT i, due to normalization, can 
be rewritten as 

6 

Sq^-jdxpix)l.2^q{f^^. (19) 

a 

since the additive divergent term lim„^oo ln2-g {n) is omitted due to the fact that the 
entropy is not absolute but only its change can be measured. This result can also be 
obtained by plugging the definition in Eq. ( fTSI l into Eq. (10) of Ref. |[T]. This last 
equation i.e., Eq. ( fTsT l. is essential, since it shows that the continuous form of q-entropy 
(just like BG case in the previous section, note that the left hand side of the equation 
above is discrete g-entropy but in the n ^ co limit) is given by the negative of the 
corresponding g-relative entropy i.e., the integral in the right hand side of Eq. ( fT9] l ||9]| . 

It can now be seen that none of the divergences mentioned by Abe [ 1 j occurs in 
Eq. ( fT9] l, since the divergence is, again like BG entropy, additive and therefore can be 
omitted (compare Eq. (10) in Ref. 1 1 1 and Eq. ( fT9] l in the present manuscript). More- 
over, the relative entropy expression given by Eq. ( fT9] l is dimensionless and invariant 
under different reparametrization of continuum just like its BG counterpart. 



4 Conclusions 

Contrary to the recent claim by Abe fTT|, we have shown that the discrete g-entropy can 
be generalized to the continuous variables exactly in the same manner as done for the 
BG entropy. Moreover, the resulting generalization of the g-entropy to the continuum 
is dimensionless and independent of reparametrization of the continuous variables just 
as the continuous BG entropy. 
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